BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on EVT-TOTAL events by Ev. Decom. - Approx. Span & Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[EVT-TOTAL]==       1580 (  971)     1308 (  971)    61.46    74.24    67.24
[JULIELab ]       ==[EVT-TOTAL]==       1580 (  960)     1347 (  960)    60.76    71.27    65.60
[VIBGhent ]       ==[EVT-TOTAL]==       1580 (  823)     1139 (  823)    52.09    72.26    60.54
[UT+DBCLS ]       ==[EVT-TOTAL]==       1580 (  817)     1143 (  817)    51.71    71.48    60.01
[ConcordU ]       ==[EVT-TOTAL]==       1580 (  722)      951 (  722)    45.70    75.92    57.05
[ UTokyo  ]       ==[EVT-TOTAL]==       1580 (  727)     1052 (  727)    46.01    69.11    55.24
[  UNSW   ]       ==[EVT-TOTAL]==       1580 (  674)      995 (  674)    42.66    67.74    52.35
[ UZurich ]       ==[EVT-TOTAL]==       1580 (  676)     1047 (  676)    42.78    64.57    51.47
[ASU+HU+BU]       ==[EVT-TOTAL]==       1580 (  623)      849 (  623)    39.43    73.38    51.30
[ UNIMAN  ]       ==[EVT-TOTAL]==       1580 (  671)     1044 (  671)    42.47    64.27    51.14
[  SCAI   ]       ==[EVT-TOTAL]==       1580 (  665)     1043 (  665)    42.09    63.76    50.71
[ UAveiro ]       ==[EVT-TOTAL]==       1580 (  593)      868 (  593)    37.53    68.32    48.45
[ Team 24 ]       ==[EVT-TOTAL]==       1580 (  604)      948 (  604)    38.23    63.71    47.78
[UAntwerp ]       ==[EVT-TOTAL]==       1580 (  576)      906 (  576)    36.46    63.58    46.34
[   Cam   ]       ==[EVT-TOTAL]==       1580 (  538)      744 (  538)    34.05    72.31    46.30
[CNBMadrid]       ==[EVT-TOTAL]==       1580 (  832)     2028 (  832)    52.66    41.03    46.12
[  NICTA  ]       ==[EVT-TOTAL]==       1580 (  515)      790 (  515)    32.59    65.19    43.46
[ USzeged ]       ==[EVT-TOTAL]==       1580 (  653)     1473 (  653)    41.33    44.33    42.78
[CCP-BTMG ]       ==[EVT-TOTAL]==       1580 (  403)      491 (  403)    25.51    82.08    38.92
[CIPS-ASU ]       ==[EVT-TOTAL]==       1580 (  560)     1421 (  560)    35.44    39.41    37.32
[  PIKB   ]       ==[EVT-TOTAL]==       1580 (  365)      493 (  365)    23.10    74.04    35.21
[  UMich  ]       ==[EVT-TOTAL]==       1580 (  903)     3715 (  903)    57.15    24.31    34.11
[ KoreaU  ]       ==[EVT-TOTAL]==       1580 (  319)      467 (  319)    20.19    68.31    31.17
[ Team 09 ]       ==[EVT-TOTAL]==       1580 (  384)      898 (  384)    24.30    42.76    30.99

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[EVT-TOTAL]==       1722 (  873)     1218 (  873)    50.70    71.67    59.39
[ASU+HU+BU]       ==[EVT-TOTAL]==       1722 (  623)      849 (  623)    36.18    73.38    48.46
[ Team 24 ]       ==[EVT-TOTAL]==       1722 (  650)     1007 (  650)    37.75    64.55    47.64
[UAntwerp ]       ==[EVT-TOTAL]==       1722 (  578)      911 (  578)    33.57    63.45    43.90
[CNBMadrid]       ==[EVT-TOTAL]==       1722 (  907)     2416 (  907)    52.67    37.54    43.84
[CCP-BTMG ]       ==[EVT-TOTAL]==       1722 (  420)      508 (  420)    24.39    82.68    37.67

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------